IN THE CLAIMS 



1. (Previously Presented) A method comprising: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at least one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 

multimedia annotation, such that the multimedia annotation can be extracted and 
decoded subsequently from the first multimedia document and played via a 
multimedia player, wherein the first multimedia document is generated as a part 
of reproducing the paper document via a document reproduction system. 

2. (Original) The method of claim 1, wherein the multimedia annotation is represented 
as a first bar code printed on the multimedia document. 

3. (Original) The method of claim 2, wherein the first bar code encodes an audio sound. 

4. (Previously Presented) The method of claim 1, wherein a location indicator 
associated with the multimedia annotation is placed on the first multimedia document, 
wherein the location indicator indicates where the multimedia annotation can be retrieved and 
played. 

5. (Previously Presented) The method of claim 4, wherein the location indicator 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
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URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

6. (Canceled) 

7. (Previously Presented) The method of claim 1, wherein the first multimedia 
document is a paper document, wherein the multimedia annotation printed on the first 
multimedia document is capable of being extracted by scanning and decoding the printed 
annotation of the paper document, and wherein the extracted multimedia annotation can be 
played via a multimedia player. 

8. (Previously Presented) The method of claim 1, further comprising: 

generating an image of the paper document, the image of the paper document being 
unconsciously captured during the reproduction of the paper document without 
user intervention; 

creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; and 

storing the image of the paper document and the multimedia annotation in a storage. 

9. (Previously Presented) The method of claim 8, wherein the second multimedia 
document is represented as a second Uniform Resource Locator (URL) printed on the first 
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multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 

10. (Original) The method of claim 9, wherein a third bar code is used to represent the 
second URL. 

11. (Previously Presented) The method of claim 8, further comprising automatically 
sending the second multimedia document to a recipient by electronic mail as a part of 
reproducing the paper document via the document reproduction system, wherein the recipient 
is specified by a user via an interface of the document reproduction system when the user 
reproduces the paper document using the document reproduction system. 

12. (Original) The method of claim 11, wherein the recipient receives the image of the 
paper document and the multimedia annotation in the form of Multi-purpose Internet Mail 
Extension (MIME). 

13. (Previously Presented) A machine-readable medium providing instructions, which 
when executed by a set of one or more processors, cause said set of processors to 
perform the following: 

creating a multimedia annotation for a paper document, the multimedia annotation 
representing at lest one of an audio sound and a video clip; and 

creating a first multimedia document by combining the paper document and the 

multimedia annotation, such that the multimedia annotation can be extracted 
and decoded subsequently from the first multimedia document and played via a 
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multimedia player, wherein the first multimedia document is generated as a 
part of reproducing the paper document via a document reproduction system. 

14. (Original) The machine-readable medium of claim 13, wherein the multimedia 
annotation is represented as a first bar code printed on the multimedia document. 

15. (Original) The machine-readable medium of claim 14, wherein the first bar code 
encodes an audio sound. 

16. (Previously Presented) The machine-readable medium of claim 13, wherein a 
location indicator associated with the multimedia annotation is placed on the first multimedia 
document, wherein the location indicator indicates where the multimedia annotation can be 
retrieved and played. 

17. (Previously Presented) The machine-readable medium of claim 16, wherein the 
location indicator comprises a first Uniform Resource Locator (URL), and a second bar code, 
wherein the first URL is indicated in plain text, and wherein the second bar code represents 
the first URL in an encrypted form. 

18. (Canceled) 

19. (Previously Presented) The machine-readable medium of claim 13, wherein the first 
multimedia document is a paper document, wherein the multimedia annotation printed on the 
first multimedia document is capable of being extracted by scanning and decoding the printed 
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annotation of the paper document, and wherein the extracted multimedia annotation can be 
played via a multimedia player. 

20. (Previously Presented) The machine-readable medium of claim 13, further 
comprising: 

generating an image of the paper document, the image of the paper document being 

unconsciously captured during the reproduction of the paper document without 
user intervention; 

creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; 
and 

storing the image of the paper document and the multimedia annotation in a storage. 

21. (Previously Presented) The machine-readable medium of claim 20, wherein the 
second multimedia document is represented as a second Uniform Resource Locator (URL) 
printed on the first multimedia document, and wherein the image of the paper document and 
the multimedia annotation is accessed with the second URL. 

22. (Original) The machine-readable medium of claim 21, wherein a third bar code is 
used to represent the second URL. 
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23. (Previously Presented) The machine-readable medium of claim 20, further 
comprising automatically sending the second multimedia document to a recipient by 
electronic mail as a part of reproducing the paper document via the document reproduction 
system, wherein the recipient is specified by a user via an interface of the document 
reproduction system when the user reproduces the paper document using the document 
reproduction system. 



24. (Original) The machine-readable medium of claim 23, wherein the recipient receives 
the image of the paper document and the multimedia annotation in the form of Multi-purpose 
Internet Mail Extension (MIME). 



25. (Previously Presented) A computer system, comprising: 
a bus; 

a data storage device coupled to the bus; and 

a processor coupled to the data storage device, the processor operable to receive 

instructions which, when executed by the processor, cause the processor to 
perform a method comprising 

creating a multimedia annotation for a paper document, the multimedia 

annotation representing at least one of an audio sound and a video clip; 
and 

creating a first multimedia document by combining the paper document and the 
multimedia annotation, such that the multimedia annotation can be 
extracted and decoded subsequently from the first multimedia 
document and played via a multimedia player, wherein the first 
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multimedia document is generated as a part of reproducing the paper 
document via a document reproduction system. 

26. (Previously Presented) The computer system of claim 25, wherein the multimedia 
annotation is represented as a first bar code printed on the multimedia document. 

27. (Original) The computer system of claim 26, wherein the first bar code encodes an 
audio sound. 

28. (Previously Presented) The computer system of claim 25, wherein a location 
indicator associated with the multimedia annotation is placed on the first multimedia 
document, wherein the location indicator indicates where the multimedia annotation can be 
retrieved and played. 

29. (Previously Presented) The computer system of claim 28, wherein the address 
comprises a first Uniform Resource Locator (URL), and a second bar code, wherein the first 
URL is indicated in plain text, and wherein the second bar code represents the first URL in an 
encrypted form. 

30. (Canceled) 

31. (Previously Presented) The computer system of claim 25, wherein the first 
multimedia document is a paper document, wherein the multimedia annotation printed on the 
first multimedia document is capable of being extracted by scanning and decoding the printed 
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annotation of the paper document, and wherein the extracted multimedia annotation can be 
played via a multimedia player. 

32. (Previously Presented) The computer system of claim 25, further comprising: 
generating an image of the paper document, the image of the paper document being 

unconsciously captured during the reproduction of the paper document without 
user intervention; 

creating a second multimedia document by combining the image of the paper 

document and the multimedia annotation, wherein the multimedia annotation is 
captured via an input device of the document reproduction system while the 
paper document is being reproduced via the document reproduction system; 
and 

storing the image of the paper document and the multimedia annotation in a storage. 

33. (Previously Presented) The computer system of claim 32, wherein the second 
multimedia document is represented as a second Uniform Resource Locator (URL) on the first 
multimedia document, and wherein the image of the paper document and the multimedia 
annotation is accessed with the second URL. 

34. (Original) The computer system of claim 33, wherein a third bar code is used to 
represent the second URL. 

35. (Previously Presented) The computer system of claim 32, further comprising 
automatically sending the second multimedia document to a recipient by electronic mail as a 
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part of reproducing the paper document via the document reproduction system, wherein the 
recipient is specified by a user via an interface of the document reproduction system when the 
user reproduces the paper document using the document reproduction system. 

36. (Original) The computer system of claim 35, wherein the recipient receives the image 
of the paper document and the multimedia annotation in the form of Multi-purpose Internet 
Mail Extension (MIME). 

37. (Previously Presented) A method comprising: 

creating a paper document to be used with a multimedia annotation; 

creating the multimedia annotation, the multimedia annotation representing at least 
one of an audio sound and a video clip; 

storing an image of the paper document and the multimedia annotation; and 

creating a multimedia document by combining the paper document and the multimedia 
annotation, such that the multimedia annotation can be extracted and decoded 
subsequently from the first multimedia document and played via a multimedia 
player, wherein the storing and the combining are performed as a part of 
reproducing the paper document via a document reproduction system without 
user intervention. 

38. (Previously Presented) The method of claim 37, wherein combining the document 
and the multimedia annotation comprises: 

creating a paper multimedia document by associating the multimedia annotation with 
the paper document; and 
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creating an electronic multimedia document by associating the multimedia annotation 
with the image of the paper document, wherein the image of the paper 
document is captured while the paper document is being reproduced using the 
document reproduction system. 

39. (Previously Presented) The method of claim 38, wherein the multimedia annotation 
associated with the paper multimedia document is represented as a first bar code printed on 
the paper multimedia document, wherein the first bar code encodes an audio sound, wherein 
the first bar code printed on the paper multimedia document is capable of being extracted by 
scanning and decoding the first bar code printed on the paper multimedia document, and 
wherein the extracted first bar code can be played via a multimedia player. 

40. (Original) The method of claim 38, wherein a location indicator of the multimedia 
annotation associated with the paper multimedia annotation is placed on the paper multimedia 
document, wherein the location indicator indicates where the multimedia annotation can be 
retrieved and played. 

41. (Original) The method of claim 40, wherein the location indicator comprises a 
Uniform Resource Locator (URL), and a second bar code, wherein the URL is indicated in 
plain text, and wherein the second bar code represents the URL. 

42. (Canceled) 
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43. (Previously Presented) The method of claim 38, further comprising automatically 
sending the electronic multimedia document to a recipient as a part of reproducing the paper 
document via the document reproduction system, wherein the recipient receives the electronic 
multimedia document in the form of an attachment to an electronic mail, wherein the recipient 
is specified by a user via an interface of the document reproduction system when the user 
reproduces the paper document using the document reproduction system. 

44. (Previously Presented) The method of claim 3, wherein the multimedia document is a 
physical document having the first bar code printed thereon, wherein the audio sound can be 
extracted from the multimedia document by scanning and decoded the first bar code, and 
wherein the extracted audio sound is capable of being played via an audio player. 

45. (Previously Presented) The method of claim 8, further comprising capturing an audio 
sound of the multimedia annotation from a user using a microphone of the input device when 
the user reproduces the paper document using the document reproduction system. 

46. (Previously Presented) The method of claim 45, wherein the microphone is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

47. (Previously Presented) The method of claim 8, further comprising capturing a video 
clip of the multimedia annotation from a user using a video camera of the input device when 
the user reproduces the paper document using the document reproduction system. 
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48. (Previously Presented) The method of claim 47, wherein the video camera is 
automatically activated when the user selects a reproduction function of the document 
reproduction system to reproduce the paper document. 

49. (Previously Presented) The method of claim 8, further comprising, in response to a 
request to retrieve the second multimedia document, performing a content-based search for 
the requested multimedia document within the storage based on content of the multimedia 
annotation associated with the requested multimedia document. 

50. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via an optical character recognition (OCR) process on the multimedia annotation of 
the multimedia documents being searched. 

51. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed via a speech recognition mechanism on an audio sound of the multimedia 
annotation of the multimedia documents being searched. 

52. (Previously Presented) The method of claim 49, wherein the content-based search is 
performed on a video clip of the multimedia annotation based on an image of the user using 
face recognition techniques. 
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